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Abstract 

For  random  walks  {Sn}  whose  distribution  can  be  embedded  in  an  exponential  family 
large  deviation  approximations  are  obtained  for  the  probability  that  rnaxo<t<y<m(S'y  —  5t)  >  b 
(i)  conditionally  given  Sm  and  (ii)  unconditionally.  The  method  used  in  the  conditional  case 
seems  applicable  to  maxima  of  a  reasonably  large  class  of  random  fields.  For  the  unconditional 
probability  a  more  special  argument  is  used,  and  more  precise  results  obtained. 
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1,  Introduction 


Hogan  and  Siegmund  (1986)  adapt  the  method  developed  by  Pickands  (1969),  Qualls 
and  Watanabe  (1973),  and  Bickel  and  Rosenblatt  (1973)  to  obtain  explicit  large  deviation 
approximations  for  the  maxima  of  several  Gaussian  random  fields  arising  in  statistics.  Using  a 
special  argument  for  one  particular  case,  they  suggest  a  heuristic  second  order  approximation 
for  that  case;  and  they  show  by  a  Monte  Carlo  experiment  that  the  second  order  approximation 
frequently  gives  considerably  better  numerical  results 

The  purpose  of  this  paper  is  to  show  that  the  method  developed  by  Woodroofe  (1976, 
1982)  for  problems  in  one  dimensional  time  can  be  adapted  to  study  maxima  of  random 
fields.  Overall  it  involves  simpler  computations  than  the  previous  method  and  consequently 
seems  potentially  capable  of  delivering  a  genuine  second  order  approximation  should  one  seem 
desirable.  See  Woodroofe  and  Takahashi  (1982)  for  an  example  in  one  dimensional  time 

Let  be  independent,  identically  distributed  random  variables,  and  put  Sn  = 

xi  4 —  +  xn  (n  =  0, 1,  •  •  •).  For  b  >  0  define 

t  —  t(b)  —  inf{n  *  max  ( Sn  -  S*)  >  6}, 

Theorem  1  below  gives  a  large  deviation  approximation  to  the  conditional  probability 

(1)  P{t<m\Sm=  0  (e  <  b) 

when  the  distribution  of  the  x’s  can  be  embedded  in  an  exponential  family  Although  we 
discuss  only  this  concrete  case,  it  will  be  apparent  that  the  method  is  reasonably  general.  See 
Hogan  and  Siegmund  (1986)  and  Section  4  for  additional  examples.  For  applications  of  (l)  see 
Levin  and  Kline  (1985)  and  Brown  and  Adler  (1986) 

The  unconditional  probability 

(2)  P{t  <  m} 

gives  the  distribution  of  the  run  length  of  a  CUSUM  test  (e.g  van  Dobben  de  Bruyn,  1968) 
and  the  probability  that  at  least  one  among  the  first  m  customers  in  as  single  server  queue 
has  a  waiting  time  exceeding  b  Several  recent  papers  have  discussed  its  numerical  evaluation 
(e.g.  Woodhall,  1983,  Waldmann,  1986) 
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Although  the  method  of  Theorem  1  can  also  be  applied  to  the  unconditional  proability  (2), 
one  can  use  a  special,  considerably  simpler  argument  and  obtain  a  more  precise  approximation, 
which  in  this  case  provides  justification  for  the  Hogan-Siegmund  heuristic  and  indicates  what 
one  can  expect  to  gam  from  second  order  approximations  in  related  problems.  This  line  of 
reasoning  is  developed  in  Section  3. 

Section  4  contains  additional  examples  and  miscellaneous  remarks 
2  Conditional  Probability 

In  order  to  facilitate  comparisons  between  Theorem  1  below  and  the  related  Theorem 
8,72  of  Siegmund  (1985),  we  use  the  notation  of  that  result,  which  was  proved  by  a  method 
which  does  not  seem  to  adapt  to  multidimensional  indexing  sets.  Here  we  modify  a  method 
developed  by  Woodroofe  (1976,  1982)in  one  dimensional  time. 

The  following  discussion  omits  some  technical  details  which  occur  even  in  the  one  di¬ 
mensional  case  and  concentrates  on  issues  which  only  arise  because  of  the  multidimensional 
indexing  set. 

Let  Pp  denote  the  probability  which  makes  a?i,  X2>  •  •  •  independent,  identically  distributed 
random  variables  with  probability  distribution  of  the  form 

P„{xn  6  dx}  =  exp[0x  —  t p(6)]dF(x) 

relative  to  some  fixed  probability  distribution  F ,  which  without  loss  of  generality  is  assumed 
to  have  mean  0.  The  parameters  /z  and  9  have  the  one  to  one  relation  /z  =  rp*(9)  (=  E^xi).  In 
Section  3  it  is  notationally  convenient  to  standardize  F  to  have  unit  variance 

Let  Sn  =  xi  +  *  •  •  +  xn  (n  =  0, 1,  •  •  •). 

It  is  convenient  to  assume  that  for  all  /z  there  exists  and  no  such  that 

/oo 

|i£#1exp(»Axi)|nodA  <  oo 

-OO 

This  imples  that  for  all  n  >  no  the  distribution  of  Sn  has  a  continuous,  bounded  density 
function,  /Mi„,  and  as  n  — ►  oo 

(3)  f^,n{onll2y  +  n/z)an/2  ->  <p{y) 
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uniformly  in  y,  where  a2  =  t/>"(0)  and  <p  denotes  the  standard  normal  density  function  (cf. 
Feller,  1972,  p.  516)  Also  assume  that  x\  has  a  density  function.  An  alternative  technical 
condition  would  be  that  F  is  an  arithmetic  distribution;  and  by  using  the  technique  of  Lalley 
(1984),  one  can  perhaps  eliminate  all  such  assumptions. 

Let 

P<m)(A)  =  P„(A  |  5m  =  0 

for  events  A  defined  in  terms  of  xj,  *  •  • ,  xm  By  sufficiency  the  conditional  probability  does  not 
depend  on  fx.  Also  let 

r+(r_)  =  inf {n  :  Sn  >  (<)0> 

Theorem,  1.  Let  b  =  m;  and  £  =  m£0  for  arbitrary  fixed  f  >  0  and  fo  <  ?  Assume  there  exist 
/i2  <  0  <  fii  (necessarily  unique)  such  that 

(4)  1  =  A4  +  |/i2|  ^f-Co) 

and 

(5)  m^y\  = 

where  6(n)  denotes  the  inverse  of  the  function  p,  =  i p'(6).  Let  0,-  =  6(m)  (t  =  1,2),  60  =  0(£o), 
and  a2  =  i/>"(0,-)  (»  =  0, 1, 2).  Then  as  m  — *•  oo 

(6)  Pjm){f  <  m}  ~  mC(f ,  £0)  exp[-mP(f ,  $>)], 
where 

(7)  B(f,  fo)  =  (^i  —  #2)f  ~  ^(^2)  +  t/>(^o)  +  (^2  —  O0WW0) 

and 

m  rU  C\=  PtoiT+  =  °°}PM.{r-  =  °°>  Mj  ~  go)|M2l~1 

1  }  K  Co;  {h  -  -  e0)/|M2|3)1/2 

Remarks,  (i)  To  evaluate  C(f ,  £o)  it  is  usually  adequate  to  use  the  approximation 
(9)  phAt+  =  =  °°}/[(0i  -  *2)^1]  =  exp[-(6>!  -  62)p+]  +  o[{e1  -  62)2} 
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as  $i  —  6 2  — ►  0,  where  p+  =  EoS^/(2EoST^_)  an  be  calculated  numerically  (cf  Siegmund, 
1985,  Proposition' 10.37  and  Theorem  10.55).  A  similar  approximation  holds  for  P^2{r^  = 
°°}^i{T-  =  °°}/[(^i  “  ^2)  1/^2 1]  in  terms  of  />_  =  Eo(S?_)/(2EoST_).  (ii)  In  the  case  dF{x )  = 
<p(x)dx  it  is  easy  to  see  that  jii  =  — /i2  =  2f  —  £o>  so  Theorem  2  of  Hogan  and  Siegmund  (1986) 
is  a  special  case. 

Proof  of  Theorem  1.  Let  0  <  i’o  <  jo  <  m  and  let 

J  =  J{io,jo)  =  {(*\j)  :  0  <  i  <  j  <  m,  j  <  j0  or  j  =  jb  and  t  <  t0} 

Then 

(10) 

P^m){i  <  m} 

/OO 

P£(m){5io  -  5io  €  b  +  dx}p(m){5y  -  Si  <  b  V(»,i)  €  7  I  Sy0  -  5io  =  6  +  *}. 

*0<J0  J 

From  Lemma  1-5  below,  all  of  which  involve  standard  arguments,  one  obtains  (6),  but  with  a 
constant  C  of  the  form 

(11)  C  =  ^[second  fraction  in  (8)]//ii|/i2|. 

In  (11) 

TOO 

(12)  C'  =  /  e~^1~e^xPui{maxSn  <  -x}Pu1{min5rt  +  min5^  >  x}dx, 

JO  n>l  n>0  n>l 

where  {S'n)n  =  0, 1,  •  •  •}  is  an  independent  copy  of  the  random  walk  {Sn,  n  =  0, 1,  •  •  •}.  The 
proof  of  Theorem  1  is  completed  by  the  evaluation  of  C*  given  below  in  Lemma  7. 

Lemma  1  is  an  easy,  well  known  consequence  of  (3)  and  the  relation 

/o,»(y)  =  exp[-0y  +  ny>(0)]/A,n(y), 

where  jl  =  i/>'(0)  =  y/n.  (Actually  (3)  must  be  strengthened  slightly  to  provide  for  the  desired 
uniformity.) 

Lemma  1.  Let  /x  =  t /?'(0),  cr 2  =  t/>"(0),  and  assume  |x|  <  <5nn2/3  for  some  sequence  6n  — ►  0. 
Then  uniformly  in  x  as  n  — ►  oo 

/o,n(«M  +  x)  ~  exp[— 0(n/x  +  x)  +  nxj>($)]<p(x/ cn1/2) f an1/'’ 
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Lemmas  2  and  3  follow  form  Lemma  1,  some  standard  estimates,  and  the  identity 
p(m){5n  e  dy}  =  /o,n(y)/o1m-»(e  -  y)//o,m(0- 

Let  D  =  {(to,  jo)  :  t‘o  >  m1/2,  j0  <m  —  m1/2,  \j0  -  t0  -  m$/m\  <  m7/12} 

Lemma  2.  As  m  — >  oo 


and 


where  <$(x) 


Y2  -  Sio  >  b)  =  °[m  exp{— mS(f ,  &>)}] 


y:  P^m){5j0  -  S<0  >  6  +  x}  <  «(i)mexp{-mB(f^o)}, 

(*oJo)ED 

0  as  x  — »  oo 


Lemma  3.  Suppose  (to,  Jo)  €  D  and  put  n  =  j 0  —  »o-  Then  uniformly  in  (t'o,  Jo)  and  I1]  <  m1/12 
Pcm)(5io  “  Si0  Gmf  +  dx}  ~  exp[-mB(f,  £0)  -  (#1  -  ^2)*] 


(13) 


(27rm)1/Vo 


|M2|(n  -  rn$/ni)' 

IT 

1 

3 

a2(m  — n)1/2 

(Tin1/2 

dx. 


Although  the  following  lemma  is  not  difficult  to  prove,  its  importance  cannot  be  over 
emphasized.  It  shows  that  the  two  dimensional  random  field  under  consideration  here  behaves 
locally  like  a  superposition  of  independent  one  dimensional  random  fields,  and  thus  makes 
possible  the  explicit  evaluation  of  C. 


Lemma  4.  Suppose  iq  >  m1/2,  jo  <  m  —  m1/2  and  jo  —  »o  ~  Then  uniformly  in  (to,  jo) 

and  x  in  compact  subsets  of  [0,  oo) 

P^Vy  -  St  <  b  V(«,i)  €  J  I  Sj0  -  Sio  =  b  +  x} 


(14) 


Pu2{maxSn  <  —  x}Pn  {minSn  +  minS^  >  x}, 

n>  1  n>0  n>  1 


where  {S^,  n  =  0, 1,  •  *  *}  is  an  independent  copy  of  {Sn,  n  =  0, 1,  •  •  •} 


Proof.  Given  Sjo  S<o  =  +  x,  the  event  on  the  left  hand  side  of  (14)  equals 

{Sio  -  sio-j  +  (S»o+*  -  S,0)  >  x  V(t,j)  :  (»0  +  i,j0  -  j)  €  J} 


It  is  easy  to  see  that  in  the  quantification  V(t,  j)  such  that  (t*o  + t,  jo  —  j)  G  J  the  indices  (*,  j) 
with  t  <  —1  and  j  >  1  are  redundant,  because  the  required  inequality  holds  for  these  (t,  j)  if 
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it  holds  for  *  <  —  1,  j  —  0  and  for  *  =  0,  j  >  1  Hence  the  event  above  equals 
{^*o+*  Sk0  >  x  V  t  <  —  1  :  (t0  +  t)  jo)  £  J i 

sj0  -  Sj0-j  +  Sio+i  -  Sio  >  X  V  t  >  0,  j  >  1  :  (to  +  t,  jo  -  j)  G  J}, 
which  is  contained  in  or  contains 


{  ,  (Si»+i  -  Sio)  >  x>  min  {Sjo  -  Sjo-j)  +  min  (5,0+t-  -  Sio  >  *}, 

~n<t<  — 1  lSJ<n  0<t<n 

according  as  n  is  arbitrary,  but  fixed,  or  n  =  jo  —  to- 

It  is  easy  to  see  that  for  arbitrary  n  =  1,2,**-,  given  Sm  =  m£o  and  Sjo  Sio  —  m?  x> 
as  m  — *  oo  the  joint  distribution  of 


Sjo  Sjo  —j  f  3  *  *  *  j  ** 

converges  to  the  p»  t  joint  distribution  of  Sj,  j  =  0, 1,  •  •  • ,  n;  the  joint  distribution  of 

Sio  j  *  *  ’ "  >  ^ 


converges  to  the  PMl  joint  distribution  of  St  ,  t  =  0, 1,  •  • ,  n,  the  joint  distribution  of 

S%o+i  ~  Si0 ,  t  0,  1,  •  •  • ,  fi 

converges  to  the  PM2  joint  distribution  of  —  S{,  t  =  0, 1,  •  •  *,  n,  and  asvmptotically  these  three 
collections  of  random  variables  are  stochastically  independent. 

The  proof  is  completed  by  letting  m  — »  oo  with  n  held  fixed  and  the  three  minima 
restricted  to  indices  with  \i\  <  n  and  j  <  n,  then  letting  n  — ►  oo  and  showing  that  the  indices 
|t |  >  n  or  j  >  n  do  not  contribute  in  the  limit.  The  details  of  this  final  step  are  similar  to  the 
one  dimensional  case  and  are  omitted. 


Lemma  5.  As  oo 

V'  f  pH/,?,  -  <?.- 


J2  /  Pf]{Sjo  -  5,0  G  b  +  dxyPf’iSj  -  Si  <b  V(t,i)  G  J  I  Sjo  -  Sio  =  b  +  x} 

~  Right  hand  side  of  (6) 
with  C  as  given  in  (11)  and  (12). 


Proof.  To  sum  the  approximations  provided  by  Lemmas  2-4  over  D ,  observe  that  by  (4) 
there  are  asymptotically  m(l  —  ?/mi)  =  m(£  —  £o)/|M2|  terms  t‘o,  and  for  each  t’o  the  sum  over 
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Jo  =  »o  +  rt  of  (from  (13)) 


(27rm)1/2<Jo 
G \<7  2M1/2  (m  —  n)1/2*^ 


'|/i2|(n  -  rn$/my 

'm(n  -  m$/n i)' 

o<i{rn  —  n)1/2 

<P 

Gin1/2 

converges  to 

+ ff|(f  -  fo)/iM2is}_l/2. 

To  complete  the  proof  of  the  theorem  we  must  evaluate  the  constant  Cf  defined  in  (12), 
This  part  of  the  argument  seems  substantially  more  difficult  than  the  analogous  result  of  Hogan 
and  Siegmund  (1986,  Lemma  3.4).  The  following  lemma  is  well  known  (e.g.  Woodroofe,  1982, 

p.  26). 


Lemma  6.  For  x  >  0 


PMl{minSn  >x}  =  tiiP^{ST+  >  *}/£„,  (ST+) 


and 


P (12 (max  Sn  <  -x)  =  HtP^iSr.  <  -x}/E,l2ST_ 

n>l 


Lemma  7.  Let  {S1^,  n  =  0, 1,  •  •  •}  be  an  independent  copy  of  {Sn,  n  =  0, 1,  •  •  •}. 


(15) 


roo 

/  exp[(#i  —  02)x\Pfl2{ma,x Sn  <  — ®}PMl{min<Sn  +  min  S'n  >  x}da 
Jo  n>l  n>0  n>l 


(O1-O2)  lPL iT+  =  °°}-Pu ,{r-  =  00} 


Proof.  For  y  <  0  let  r(y)  =  inf{n  :  Sn  <  y},  and  observe  that  by  Wald’s  likelihood  ratio 
identity  and  (5) 

(16)  Pm{r{y)  <oo}  =  Efi2  exp[(#i  -  02)SV(v)]- 
Also 

(17)  P^immSn  <y}  =  PMl{r(y)  <00}  (y  <  0) 

0 

If  one  writes  the  convolution  appearing  in  the  integrand  in  (15)  as  an  integral,  and  uses  Lemma 
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6,  (16),  and  (17),  after  some  manipulation  one  obtains 

TOO 

/  exp[(0!  -  02)s]P/i2{maxSn  <  -x}P^  {min5n  +min  S„  >  x}da 

JO  n<l  n<0  n< 1 

=  E  PbL  I  r  PM-  < 

or+|^M2<br- 1  J0 

roo 

•  /  pm{ST+  e  C?T7>[1  -  Eft2  exp{(0!  -  ^2)5T(x_n)}]d® 

J  2 

roo 

/  ■P„1{Sr+edr?K(*l~M,J 

Jo 


'  X 

M lj/f2| 

■E/iiS'r+ 


L 


'  p»ASt-  <  -»} 


{exp[(0i  -  02)(*7  “  z)  -  EM2  exp[(0x  -  ^2)(5r(I-.r?)  +  rj  -  x))dx 


Consider  the  inner  integral  to  be  of  the  form  (in  the  notation  of  Feller,  1971,  Chapter 
XI)  Fo  *  Z(r /),  where  c?Fo(x)  =  P^2{|^t_|  <  x}dx/\E^2Sr_\  is  the  stationary  distribution  for 
the  renewal  process  determined  by  F(x)  —  Pfl2  {|£y_|  <  x}  and  Z  is  a  solution  of  the  renewal 
equation  Z  =  z  +  F  *  Z ,  or  equivalently  in  terms  of  the  renewal  measure  U ,  Z  =  U  *  z.  It 
is  known  that  Z  determines  z  uniquely;  and  since  Fo  is  the  stationary  distribution,  Fo  *  U  is 
proportional  to  Lebesgue  measure  and 


Fo  *  Z(rj)  ^  (Fo  *  U)  *  z{rj)  =  T  z(x)dx/\Efl2ST,\. 

Jo 

It  is  easy  to  see  in  the  present  case  that 


z(x)  =  exp[(0i  -  02)x][l  -  exp{(0i  -  02)Sr_}], 


and  hence  the  left  hand  side  of  (15)  equals 
M1M2 [1  -  Efi2  exp{(0i  -  62)St_} 


roo  rr} 

/  Pftl{ST+  G  /  e^-^dx 

Jo  Jo 


Efii  ‘S'r-f  |  Ep2  ST_  I 

_  Mi|M2|[1  -  E ^  exp {(02  -  W_}][1  -  E^  exp{-(0!  -  02)Sr+}] 
{91-62)EtllST+\ElliST.\ 

=  Pli{r-  =  oo}P^{r+=cX>}/(e1-e2) 

where  the  last  equality  is  a  consequence  of  Wald’s  identities  and  the  relations  P*Ar- 
°°}Efll(r+)  =  1,  Pfi2{r+  =  oo}JSM(r_)  =  1 


3.  Unconditional  Probability 

We  continue  to  use  the  notation  of  Section  2  and  consider  the  unconditional  probability 
(2)  with  P  —  Pp  for  some  [i  <  0.  In  principle  one  can  obtain  a  first  order  large  deviation 
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approximation  for  Pp{t  <  m}  by  integrating  the  approximation  of  Theorem  1  with  respect 
to  the  distribution  of  Sm.  Here  we  consider  a  different  approach  and  obtain  a  second  order 
approximation  to  (2).  This  method  was  mentioned  briefly  in  Siegmund  (1986),  and  for  a 
related  continuous  time  problem  it  was  used  by  Hogan  and  Siegmund  (1986). 

The  proofs  of  the  following  results  are  for  the  most  part  modifications  of  arguments  given 
in  Siegmund  (1975,  1979)  -  see  also  Siegmund  (1985),  Chapters  VIII  and  X).  Consequently 
the  steps  of  the  argument  are  given  in  a  sequence  of  lemmas,  but  most  details  are  omitted. 

Theorem  2  Assume  that  the  P ^  distributions  of  x\  are  strongly  nonarithmetic  in  the  sense 
that 

limsup  \E^  exp(t’Axi)|  <  1, 

Let  fi 2  <  0  and  assume  there  exists  /ii  >  0  such  that  (5)  holds.  Let  A  =  6 1  —  #2>  where 
=  #(/i,)  (t  =  1,2).  Let  b  >  0  and  assume  that  for  some  8  >  0 

(18)  mfjii/b  >1  +  5,  m2  exp(— A6)  — »  0, 

Then  as  m,  b  oo 

(19)  P^2{t  <  m}  =  A|/z2|i/+*/-  exp(-A6){m  -  b/fii  +  D  +  o(l)}, 
where 

(20)  v+  =  PM3{t+  =  oo =  oo}/(miA),  u _  =  mi/+/\n2\t 
and 

D  =  1  —  E^S^/ (2EfilST+)  —  Etll  (SV_ ;  r_  <  oo)-E/ai(t+) 

(21)  +  T-  <  °°)^Mi(r+)  +  EnAT+\  t+  <  oo)E^[t-) 

POO 

-  (Mii'+r1  /  {Efn  exp[-A(Sr(«)_«)  -  v+)PMl  {min  Sn  >  -x }dx, 
with  t[x)  =  inf{n  :  Sn  >  x}. 

Remark.  The  constant  in  (19)  and  (20)  is  the  first  factor  in  the  constant  C  of  (6)and 

(8).  The  local  expansions  of  Remark  (i)  following  Theorem  1  applied  to  and  z/_  together 
with  the  similar  local  expansion  of  D  given  in  Theorem  3  below  lead  to  the  much  simpler 
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approximation 


(22)  P^{t  <  m)  =  exp[— A(6  +  p+  -  P-)]{A|//2|[™  -  *(&  +  P+  ~  P-)]  +  3  -  77A/6}, 

where  7  =  Eqx\  and  the  Pq  distribution  of  has  been  standardized  to  have  unit  variance.  In 
the  case  of  the  unconditional  probability  (2),  (22)  gives  precise  meaning  to  the  Hogan-Siegmund 
heuristic  approximation  (which  applies  only  when  7  =  0). 

Theorem  3.  Assume  that  the  Pq  distribution  of  xi  is  standardized  to  have  unit  variance  For 
D  given  by  (21),  as  A  — ►  0 

A|/z2| D  =  3  -  A|/x2| (/>+  “  P-)/p  1  -  7A7/6+  o(A), 

where  p±  =  \Eq{S*±)/ Eq{St±)  and  7  =  S0xf. 

Table  1  contains  some  values  of  p  =  <  m}  computed  numerically  by  Waldmann 

(1986).  For  comparison  it  gives  first  order  (pi)  and  second  order  (p2)  approximations  from  (22) 
The  x’s  are  normally  distributed  with  mean  p  =  —.5  and  6  =  3  The  value  of  =  |p_|  =  583 
(e  g  Siegmund,  1985,  p.  225).  The  approximation  p2  is  quite  good,  but  p\  is  rather  poor 
However,  the  values  of  b  and  m  are  quite  small  Hogan  and  Siegmund  (1986)  compared  similar 
approximations  for  (1)  in  a  Monte  Carlo  experiment  involving  generally  larger  sample  sizes 
and  found  that  the  first  order  approximation  was  reasonably  good  when  £  <  0  but  not  when 
£  >  0.  Their  heuristic  second  order  approximation  was  good  in  all  cases.  Some  Monte  Carlo 
experimentation  shows  that  the  approximation  p2  begins  to  deteriorate  when  p  is  about  .2, 
and  as  expected  is  poor  for  large  values  of  p. 

TABLE  1 


Approximations  to  p  —  P^{t  <  m} 


m 

P 

Pi 

P2 

9 

.054 

.023 

.052 

12 

.079 

.047 

.076 

15 

.102 

.070 

098 

18 

.126 

.093 

.122 
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Theorem  2  is  a  consequence  of  Lemmas  8-12 
Let  T  —  mf{n  :  Sn  ^  (0,  &)}, 


Lemma  8  For  arbitrary  b  >  0,  /x  <  0 

Pp(t  <  m}  <  P^{r+  =  oo}£^{(m  —  T  +  l),  T  <  m,  St  >  b} 

(23)  ”*-1 

+  PM{n  <  r+  <  oo}PM{T  <  m  —  n,  5^  >  6}. 

n=0 

A  lower  bound  for  P^{t  <  m}  is  given  by  the  right  hand  side  of  (23)  divided  by  1  + 

PM{(m  -  T  +  1);  T  <  m,  ST  >  b}. 

Proof.  See  Siegmund  (1986),  Proposition  3.23. 

Lemma  9  Under  the  condition  (18) 

Pya{t  <m}  =  Ph2{t+  =  oo }Efi2(m  -T  +1;  T  <  m,  ST  >b) 

+  Eft7{r+‘,  t+  <  oo)PM2{Sr  >b}  +  o(e~Ab ) 

Proof  Lemma  9  follows  from  Lemma  8,  the  inequality 

PM2{m  —  T  +  1;  T  <  m,  St  >  b}  <  mPM2{Sr  >  b}  <  me'Ai, 

and  a  related  elementary  inequality. 

Lemma  10.  Under  the  conditions  of  Theorem  2 

PM2{T  <  m,  ST  >  b}  =  P^{ST  >  6}(1  +  ofm"1)) 

=  i/+PMl{r_  =  oo}  exp(-A6)(l  +  o(m-1)) 

and 

Efi2 {T ;  T  <  m  ST  >  b)  =  v+  exp(-A6){PMl{r_  =  oo}[6  +  p+(m)\/ni 
+  /^1P/n(ST_;  t-  <  oo)  -  r_  <  oo) 

+  PMl{r-  =  oo}(i/+/ii)-1 

+  oC1)}) 

where  p+(m)  =  %Ey1{S?+)/Ey1(ST+). 

Theorem  2  follows  easily  by  substitution  of  the  approximations  of  Lemma  10  into  Lemma 
9  and  use  of  the  well  known  relation  p*{*-  =  oo}  =  l/PMl(r+)  to  rewrite  the  resulting 
expression. 


POO 

J  [Ey. j  exp{-A(5T(l)  -  *)}  -  i/+]PMl{mm5n  >  -i}dx 
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Theorem  3  follows  from  Lemmas  11-12. 


Lemma  11,  Assume  that  the  Po“distribution  of  x*  has  been  standardized  to  have  variance  1. 
Then  as  A  — ►  0 

EnAT+\  t+  <o o)  =  /x]"1So(5t+)(1  -  p+n  1  +  o(A)), 

EnAT~)  =  1^o(-?T_)(l  +  p-n  2  +  o(A)), 

and 

th1  ehAst+)ehi{St-\  t-  <  oo)  =  -  (2mi)_1  +  P+  ~  ^7  +  o(l)» 
where  p±  =  \E0(S?±) / B0(Sr±)  and  7  =  E0(xf).  Also  p+  +  p-  =  ■y/S. 


Proof ^  The  first  two  approximations  have  proofs  similar  to  (9)  (cf.  Siegmund,  1985,  Proposition 
10  37).  For  the  third,  differentiate  the  Wiener-Hopf  factorization  of  the  characteristic  functions 
of  ST+  and  ST_  twice  (e.g.  Siegmund,  1985,  Theorem  8.41)  to  obtain 


E^{S?+)  E^(x\) 


Ml  r_  <  oo)  -  2E^Srj 

and  then  let  /ii  — >  0  The  identity  p+  +  p_  =  7/3  follows  easily  form  a  three  fold  differentiation 
of  the  Wiener-Hopf  factorization 


Lemma  12.  Let  r(x)  =  inf{n  :  Sn  >  x}  Then 

r  00 

/  {Em  exp[-A(5rW  -  1)]  -  i'+}P„1{minSn  >  -x}dx  -*•  0 

Jo  n^° 

as  pi  — ►  0. 


Proof.  Since  PMl  {minn>o  Sn  >  — x}  — ►  0  for  each  fixed  x  as  pi  — *•  0,  it  suffices  to  consider 
the  integral  from  xo  to  oo,  with  xo  arbitrarily  large.  Stone’s  (1965)  renewal  theorem  with 
exponentially  small  remainder  can  be  made  uniform  in  Ml,  as  indicated  briefly  by  Siegmund 
(1979),  to  show  that  for  some  8  >  0 

(24)  PMl{Sr(l)  -  x  >  y}  =  (P^Sr+r1  f°°  Pfll{Sr+  >  u}dn  +  0(e~Sx) 

Jy 

uniformly  in  y  and  fii  close  to  0.  Integration  by  parts  and  (24)  show  that  uniformly  in  /zi 

PMl  exp[-A(ST(z)  -  x)]  =  v+  +  0(e~6x), 
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which  allows  one  to  complete  the  proof  by  letting  /ii  0,  then  xq  — > ►  oo 


4  Discussion 


The  structure  which  makes  possible  the  explicit  evaluation  in  Theorem  1  is  found  in  the 
proof  of  Lemma  4,  Locally  the  increments  to  the  two  dimensional  random  field  are  approxi¬ 
mately  a  superposition  of  independent  one  dimensional  random  fields.  Somewhat  more  pre¬ 
cisely,  if  {Wm(t9j)9  iyj  =  0, 1,  •  *•,  m}  denotes  a  sequence  of  (two  dimensional)  random  fields, 
the  required  property  is  that  for  the  appropriate  (to,  jo)>  which  typically  are  proportional  to  m, 
conditional  on  Wm{%o9jo)  assuming  a  large  value,  the  increments  Wm(io  +  iy  jo  —  jr)  —  Wm(io}jo)y 
perhaps  normalized,  converge  in  law  as  m  — ►  oo  to  a  sum  of  independent  random  walks  of  the 
form  Su  +  S2j  (*' =  0,±1, ±2,  =  0,1,2,  •••). 

Although  this  property  is  quite  special,  there  are  natural  problems  which  have  the  required 
structure  Hogan  and  Siegmund  (1986)  give  some  examples.  Another  class  of  examples  involves 
the  empirical  process  as  a  function  of  the  number  of  observations,  which  in  the  limit  becomes 
the  so-called  Kiefer-Miiller  process. 

For  example,  let  W(syt)y  0  <  s  <  1,  0  <  t  <  oo,  denote  the  Gaussian  random  field  with 
mean  0  and 

EW (si,  (s2,  *2)  =  4(si  A  s2)(l  -  si  V  s2)(ti  A  t2). 


The  following  result  is  of  interest  to  a  statistician  who  several  times  as  data  accumulate  an¬ 
nounces  Kolmogorov-Smirnov  confidence  bands  for  a  distribution  function  and  wants  to  know 
the  overall  confidence  to  attach  to  the  several  statements.  A  related,  slightly  different  re¬ 
sult  gives  an  approximation  to  the  asymptotic  significance  level  of  a  nonparametric  test  for  a 
change-point  discussed  by  Deshayes  and  Picard  (1981)  and  Picard  (1985).  For  fixed  c  >  0  and 
mo  =  mto  <  mi  =  mti,  as  n  — ♦  00 


(25) 


P 


max 

0<t<m 


3  1/2\W(i/m,j)\  > 


~  2i/(2c)mc2exp(— 
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where 


n-^-ixn1/2^ 

=  exp(-px)  +  o(x2)  (x-»0), 

denotes  the  standard  normal  distribution  function,  and  p  =  .583.  To  obtain  the  analo¬ 
gous  result  for  a  continuous  maximization  over  s  G  [0, 1]  (resp.  t  G  [mo,  mi])  one  replaces  i^(2c) 
(resp.  i'(x))  by  1  in  (25). 

The  approximation  of  Theorem  2  is  concerned  with  the  probability  that  a  CUSUM  test 
for  a  process  which  is  in  control  terminates  well  in  advance  of  its  average  run  length.  Although 
this  probability  is  of  particular  interest,  one  would  also  like  to  have  approximations  (i)  to  the 
right  hand  tail  of  the  distribution  of  t  and  approximations  which  are  valid  (ii)  when  /i  >  0,  (hi) 
for  tests  with  fast  initial  response  feature  (Lucas  and  Crozier,  1982),  and  (iv)  for  two-sided 
tests.  Corrected  diffusion  approximations  (Siegmund,  1979,  1985)  seem  to  provide  a  unified 
approach  to  these  problems  which  takes  appropriate  advantage  of  the  special  structure  of  the 
process  Sn  —  mino<j t<n  S*  (n  =  0, 1,  •  •  •),  but  they  unfortunately  do  not  seem  to  apply  to  more 
general  random  fields. 

One  simple  approximation  in  the  special  case  7  =  Eo{x\ )  =  0  is  as  follows:  approximate 
P^{t  5:  m)  f°r  a  boundary  at  b  by  the  analogous  probability  for  a  Brownian  motion  process 
with  boundary  at  V  =  6  +  p+  —  The  approximating  Brownian  probability  can  be  evaluated 
as  an  infinite  series  (Sweet  and  Hardin,  1970)  and  for  values  of  m  which  are  not  too  small  one 
needs  only  a  single  term  of  the  series  to  obtain  good  numerical  results.  For  the  case  of  normal 
x5s  considered  in  Section  3,  one  obtains  when  —fib*  >  1  (bf  =  b  +  2 />+  —  b  +  1.166) 

2 g  sinh2(g6')  expjjxb^  -  |(m2  ~  g2)™} 

M  —b'(^‘2-q2)(l  +  nsinh2(qb')/q2b')  ’ 

where  q  >  0  satisfies  tanh(qr&')  =  —q/n 

For  the  small  values  of  m  in  Table  1  one  expects  the  approximation  provided  by  (26)  to  be 
poor  unless  one  includes  more  terms  of  the  infinite  series.  For  example,  for  m  =  12,  (26)  yields 
.070,  whereas  (22)  gives  .076  and  the  correct  value  is  .079.  For  m  =  82  and  345,  for  which 
according  to  Waldmann  (1986)  the  exact  values  of  P^{t  <  m}  are  .50  and  .95  respectively,  the 
approximation  (22)  is  poor,  but  (26)  yields  .492  and  .948. 


i/(x)  =  2x-2  exp  (  -2^ 
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The  corrected  diffusion  approach  to  distributional  problems  associated  with  CUSUM  tests 
will  be  discussed  systematically  in  a  future  paper. 

Simple  modifications  of  the  proof  of  Theorem  1  yield  a  large  deviation  approximation  for 
the  Kuiper  (1960)  statistic 

(27)  .max  {y  -  Fn{y)  -  [x  -  F„(s)], 

0<z<y<l 

where  Fn  denotes  the  empirical  distribution  for  a  sample  of  n  independent  random  variables 
uniformly  distributed  on  (0, 1).  From  a  standard  representation  of  uniform  order  statistics  by 
sums  of  exponentially  distributed  variables,  it  follows  that  the  probability  that  (27)  exceeds  f 
equals 

-P{  max.  [Wj  -  Wi  -  (j  -  »)]  >  nf  -  1  |  Wn+1  -  (n  +  1)  =  -1}, 

0<t<;  <n 

where  W *  =  t/i  +  •  •  •  +  yjb  and  the  y’s  are  independent  standard  exponential  random  variables. 
If  one  puts  m  =  n  +  1,  6  =  (m  —  l)f  —  1,  and  f  =  —  1,  this  probability  is  almost  in  the  form 
required  by  Theorem  1,  Minor  modifications  in  the  proof  of  that  result  yield 

P{  .max  [y  -  Fn{y)  -{x-  Fn(*)}]  >  ?} 

0<z<y<l 

nflx(l  -  Pi)g1/2exp{.n[(gi  -  g;)?  +  +Iog(l  -  g;)]} 

(M(i  -  *)(i  +  *5(i *«)  }])1/!  ’ 

Siegmund  (1982)  obtains  the  analogous  approximation  for  the  ordinary  Kolmogorov- 
Smirnov  statistic  and  shows  numerically  that  it  provides  extraordinarily  accurate  numerical 
results,  but  Hogan  and  Siegmund’s  (1986)  Monte  Carlo  experiment  for  a  normal  random  walk 
indicates  that  one  cannot  expect  comparable  accuracy  in  this  case,  unless  the  sample  size  is 
fairly  large.  It  would  be  interesting  to  obtain  a  second  order  approximation  along  the  lines  of 
Theorems  2  and  3. 


15 


REFERENCES 


Ader,  R  and  Brown, L.  (1986).  Tail  behavior  for  suprema  of  empirical  proesses,  Ann.  Probab . 
14. 

Bickel,  P.  and  Rosenblatt,  M.  (1973).  Two-dimensional  random  fields,  in  Multivariate  Analysis 
III,  P  K.  Krishnaiah,  ed  ,  Academic  Press,  New  York,  3-15. 

Deshayes,  J.  and  Picard,  D.  (1981).  Convergence  de  processes  a  double  indice;  Application 
aux  tests  de  rupture  dans  un  modele,  C.  R.  Acad.  Sci.  Paris  292,  449-452. 

van  Dobben  de  Bruyn,  C  S.  (1968).  Cumulative  Sum  Tests ,  Griffin,  London. 

Feller,  W.  (1972).  An  Introduction  to  Probability  Theory  and  Its  Applications ,  Vol.  II,  John 
Wiley,  New  York. 

Hogan,  M.  and  Siegmund,  D.  (1986).  Large  deviations  for  the  maxima  of  some  random  fields, 
Adv.  Appl  Math 

Kuiper,  N  H.  (1960)  Tests  concerning  random  points  on  a  circle,  Proc.  Kon.  Akad.  Wetensch. 
A63,  38-47. 

Lalley,  S  (1984)  Limit  theorems  for  first  passage  times  in  linear  and  nonlinear  renewal  theory, 
Adv.  Appl .  Probab.  16. 

Levin,  B.  and  Kline,  J.  (1985).  The  cusum  test  of  homogeneity  with  an  application  to  sponta¬ 
neous  abortion  epidemiology,  Statist,  in  Medicine  4,  469-488. 

Lucas,  J  M.  and  Crozier,  R.  B.  (1982).  Fast  initial  response  (FIR)  for  cumulative  sum  quality 
control  schemes,  Technometrics  24,  199-205. 

Pickands,  J.  (1969).  Upcrossing  probabilities  for  stationary  Gaussian  processes,  Trans.  Amer . 
Math.  Soc  145,  51-73. 

Picard,  D.  (1985).  Testing  and  estimating  change  points  in  time  series,  Adv.  Appl.  Probab. 
17,  841-867. 

Qualls,  C.  and  Watanabe,  H.  (1973)  Asymptotic  properties  of  Gaussian  random  fields,  Trans. 
Amer.  Math.  Soc.  177,  155-171. 


16 


Siegmund,  D  (1975).  Error  probabilities  and  average  sample  number  of  the  sequential  probail- 
ity  ratio  test,  J.  Roy.  Statist.  Soc.  Ser .  B  37,  394-401. 

Siegmund,  D  (1979).  Corrected  diffusion  approximations  in  certain  random  walk  problems, 
Adv  Appl,  ProbaR  11,  701-719. 

Siegmund,  D.  (1982).  Large  deviations  for  boundary  crossing  probabilities,  Ann.  Probab.  10, 
581-588. 

Siegmund,  D.  (1985)  Sequential  Analysis:  Tests  and  Confidence  Intervals ,  Springer- Verlag, 
Berlin-Heidelberg-New  York. 

Siegmund,  D  (1986) .  Boundary  crossing  probabilities  and  statistical  applications,  Ann  Statist 

14 

Stone,  C  (1965).  On  moment  generating  functions  and  renewal  theory.  Ann  Math ,  Statist . 
36,  1298-1301. 

Sweet,  A.  L.  and  Hardin,  J.  C.  (1970).  Solutions  for  some  diffusion  processes  with  two  barriers, 
J.  Appl.  Proab.  7,  423-431. 

Waldmann,  K  H.  (1986).  Bounds  for  the  distribtion  of  the  run  length  of  one-sided  and  two- 
sided  CUSUM  quality  control  schemes,  Technometrics  28,  61-67. 

Woodhall,  W.  H.  (1983).  The  distribution  of  the  run  length  of  one-sided  CUSUM  procedures 
for  continuous  variables,  Technometrics  25,  295-301. 

Woodroofe,  M.  (1982).  Nonlinear  Renewal  Theory  in  Sequential  Analysis ,  Society  for  Industrial 
and  Applied  Mathematics,  Philadelphia. 

Woodroofe,  M.  and  Takahashi,  H.  (1982).  Asymptotic  expansions  for  the  error  probabilities 
of  some  repeated  significance  tests,  Ann.  Statist.  10,  895-908.  Correction  (1985)  13. 


17 


U826396 


